Evaluation-driven design of a robust coreference resolution system
Identifieur interne : 000B14 ( Main/Exploration ); précédent : 000B13; suivant : 000B15Evaluation-driven design of a robust coreference resolution system
Auteurs : Andrei Popescu-Belis [Suisse]Source :
- Natural Language Engineering [ 1351-3249 ] ; 2003-09.
Abstract
In this paper, we describe a system for coreference resolution and emphasize the role of evaluation for its design. The goal of the system is to group referring expressions (identified beforehand in narrative texts) into sets of coreferring expressions that correspond to discourse entities. Several knowledge sources are distinguished, such as referential compatibility between a referring expression and a discourse entity, activation factors for discourse entities, size of working memory, or meta-rules for the creation of discourse entities. For each of them, the theoretical analysis of its relevance is compared to scores obtained through evaluation. After looping through all knowledge sources, an optimal behavior is chosen, then evaluated on test data. The paper also discusses evaluation measures as well as data annotation, and compares the present approach to others in the field.
Url:
DOI: 10.1017/S135132490300319X
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 001F93
- to stream Istex, to step Curation: 001917
- to stream Istex, to step Checkpoint: 000A29
- to stream Main, to step Merge: 000B31
- to stream Main, to step Curation: 000B14
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title>Evaluation-driven design of a robust coreference resolution system</title><author><name sortKey="Popescu Belis, Andrei" sort="Popescu Belis, Andrei" uniqKey="Popescu Belis A" first="Andrei" last="Popescu-Belis">Andrei Popescu-Belis</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:7B8BE4B6CF19AF6E2130BCB202CCB755980BAAB0</idno><date when="2003" year="2003">2003</date><idno type="doi">10.1017/S135132490300319X</idno><idno type="url">https://api.istex.fr/ark:/67375/6GQ-2D015P92-L/fulltext.pdf</idno><idno type="wicri:Area/Istex/Corpus">001F93</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">001F93</idno><idno type="wicri:Area/Istex/Curation">001917</idno><idno type="wicri:Area/Istex/Checkpoint">000A29</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000A29</idno><idno type="wicri:doubleKey">1351-3249:2003:Popescu Belis A:evaluation:driven:design</idno><idno type="wicri:Area/Main/Merge">000B31</idno><idno type="wicri:Area/Main/Curation">000B14</idno><idno type="wicri:Area/Main/Exploration">000B14</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a">Evaluation-driven design of a robust coreference resolution system</title><author><name sortKey="Popescu Belis, Andrei" sort="Popescu Belis, Andrei" uniqKey="Popescu Belis A" first="Andrei" last="Popescu-Belis">Andrei Popescu-Belis</name><affiliation wicri:level="4"><country>Suisse</country><placeName><settlement type="city">Genève</settlement><region nuts="3" type="region">Canton de Genève</region></placeName><orgName type="university">Université de Genève</orgName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Suisse</country></affiliation></author></analytic><monogr></monogr><series><title level="j">Natural Language Engineering</title><idno type="ISSN">1351-3249</idno><idno type="eISSN">1469-8110</idno><imprint><publisher>Cambridge University Press</publisher><pubPlace>Cambridge, UK</pubPlace><date type="published" when="2003-09">2003-09</date><biblScope unit="volume">9</biblScope><biblScope unit="issue">3</biblScope><biblScope unit="page" from="281">281</biblScope><biblScope unit="page" to="306">306</biblScope></imprint><idno type="ISSN">1351-3249</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">1351-3249</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract">In this paper, we describe a system for coreference resolution and emphasize the role of evaluation for its design. The goal of the system is to group referring expressions (identified beforehand in narrative texts) into sets of coreferring expressions that correspond to discourse entities. Several knowledge sources are distinguished, such as referential compatibility between a referring expression and a discourse entity, activation factors for discourse entities, size of working memory, or meta-rules for the creation of discourse entities. For each of them, the theoretical analysis of its relevance is compared to scores obtained through evaluation. After looping through all knowledge sources, an optimal behavior is chosen, then evaluated on test data. The paper also discusses evaluation measures as well as data annotation, and compares the present approach to others in the field.</div></front></TEI><affiliations><list><country><li>Suisse</li></country><region><li>Canton de Genève</li></region><settlement><li>Genève</li></settlement><orgName><li>Université de Genève</li></orgName></list><tree><country name="Suisse"><region name="Canton de Genève"><name sortKey="Popescu Belis, Andrei" sort="Popescu Belis, Andrei" uniqKey="Popescu Belis A" first="Andrei" last="Popescu-Belis">Andrei Popescu-Belis</name></region><name sortKey="Popescu Belis, Andrei" sort="Popescu Belis, Andrei" uniqKey="Popescu Belis A" first="Andrei" last="Popescu-Belis">Andrei Popescu-Belis</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Informatique/explor/SgmlV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000B14 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000B14 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Informatique
|area= SgmlV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:7B8BE4B6CF19AF6E2130BCB202CCB755980BAAB0
|texte= Evaluation-driven design of a robust coreference resolution system
}}
| This area was generated with Dilib version V0.6.33. |  |